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MEASURING  STUDENT  ATTITUDES  TOWARD 
THE  AIR  FORCE  TRAFFIC  SAFETY  COURSE 


I.  INTRODUCTION 

The  Air  Force  Traffic  Safety  Course  (AFTSC)  consisted  of  a 10-hour  course  of  instruction,  broken 
down  into  10  units,  covering  such  topics  as  environmental  hazards,  vehicle  control,  common  traffic 
violations,  emergency  situations,  and  mature  driving  behavior.  Mandatory  for  virtually  all  personnel 
entering  the  Air  Force,  this  course  was  being  taught  at  more  than  140  locations  in  a standardized, 
multimedia  format.  Sound/slide  presentations  and  films  delivered  the  instruction  much  like  a programmed 
text  with  student  responses  called  for  at  certain  points  in  the  program. 

In  order  to  revise  the  AFTSC  as  needed,  course  managers  desired  a standard  method  of  getting 
feedback  on  perceived  effectiveness  from  the  student  viewpoint.  This  concern  constituted  the  operational 
problem.  Assistance  in  the  development  of  measurement  procedures  was  requested  of  training  evaluation 
specialists  in  the  Air  Force  Human  Resources  Laboratory,  Technical  Training  Division. 

Given  certain  constraints  imposed  by  the  operational  setting,  it  was  proposed  that  a desirable  system 
for  monitoring  student  attitudes/opinions  would  possess  the  following  characteristics: 

1 . Data  should  come  from  an  objectively  scored  collection  method. 

2.  Opinions  about  unit  effectiveness  should  not  be  measured  for  each  student  on  every  instructional 
unit,  but  rather  a sampling  approach  should  be  taken. 

3.  A capability  for  longitudinal  analysis  should  be  available  so  that  long-term  trends  might  be 
detected. 

4.  Primary  emphasis  should  be  given  to  determining  attitudes  toward  (a)  overall  course  effectiveness, 
(b)  instructional  unit  effectiveness,  (c)  media  effectiveness,  and  (d)  deficiencies  in  the  study  environment 
(e.g.,  lighting  and  temperature). 

5.  The  capability  for  comparing  responses  of  subpopulations  on  the  basis  of  certain 
background/demographic  characteristics  (e.g.,  male  vs.  female)  should  be  included. 

6.  Simplicity  in  data  collection,  tabulation,  and  analysis  should  be  sought. 

To  achieve  these  goals,  an  approach  was  recommended  consisting  of  the  following  steps:  (a) 
questionnaire  development  and  construction,  (b)  operational  tryout  of  administrative  procedures,  (c) 
validation  and  reliability  analysis  of  the  questionnaire,  (d)  establishment  of  analysis  capability  by  the  user, 
Air  Force  Directorate  of  Aerospace  Safety , Ground  Safety  Division  (AFSET). 

This  report  covers  work  performed  in  the  first  three  steps  mentioned  in  the  preceding  paragraph.  An 
implementable  decision  will  depend  on  the  results  to  be  presented  here  and  the  extent  to  which  the 
information  gained  from  the  proposed  questionnaire  satisfies  the  needs  of  course  management  personnel. 

The  present  study  focused  primarily  on  establishing  questionnaire  validity.  Thus,  a discussion  is  given 
of  what  the  questionnaire  was  intended  to  measure,  the  characteristics  of  the  sample,  the  degree  to  which 
the  questionnaire  was  sensitive  to  differences  in  attitudes,  reliability  of  the  derived  scales,  and  the  amount 
of  success  encountered  with  the  mechanics  of  administration.  Secondarily,  the  actual  results  of  the  survey 
are  presented  as  an  example  of  the  kind  of  evaluation  report  this  critique  method  can  produce. 


II.  METHOD 

Rationale.  In  the  context  discussed  here,  an  attitude  was  viewed  as  a collection  of  opinion  statements 
(items)  with  which  respondents  agreed  or  disagreed  to  varying  degrees  of  magnitude.  These  statements  were 
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designed  to  cover  unitary  dimensions  of  attitude  (e.g.,  attitude  toward  instructional  media  and  attitude 
toward  instructor  competence).  Thus,  strong  agreement  with  items  composing  an  attitude  dimension  would 
result  in  a high  score  on  that  attitude.  To  the  extent  that  items  were  found  to  relate  to  one  another  both 
conceptually  and  empirically  (i.e. . through  observed  correlations),  an  attitude  was  said  to  exist.  Attitude 
was  then  measured  by  summing  appropriate  item  responses  to  derive  a scale  score.  In  addition  to  measuring 
attitudes,  specific  statements  about  certain  aspects  of  training  were  elicited.  These  unrelated  statements 
were  not  conceptualized  as  attitudes  but  were  treated  simply  as  opinions. 

In  order  to  measure  attitudes  at  the  course  level  separately  from  those  at  the  unit  level,  two  critique 
forms  were  produced.  For  the  Course  Critique,  five  dimensions  of  attitude  were  defined,  and  items  were 
written  to  tap  the  dimensions.  The  dimensions  of  interest  in  the  Course  Critique  were:  (a)  instructor 
personal  relations,  (b)  instructor  technical  competence,  (c)  overall  course  effectiveness,  (d)  media 
effectiveness,  and  (e)  environmental  factors.  Items  which  support  these  dimensions  appear  in  Appendix  A. 
Three  more  items,  plus  an  open-ended  section,  were  added  in  order  to  pinpoint  specific  problem  areas. 

For  the  Unit  Critique,  only  one  dimension,  designed  to  measure  instructional  unit  effectiveness,  was 
planned.  See  Appendix  B for  a listing  of  these  items.  Again,  three  additional  items  were  included  to  cover 
specific  instructional  features,  such  as  adequacy  of  response  time,  completeness  of  coverage,  and 
concreteness  of  examples. 

In  addition,  eight  items  of  background/ demographic  information  were  requested:  training  base,  major 
command,  rank,  whether  the  respondent  was  an  officer  trainee,  sex,  status  (student  or  permanent  party), 
age,  and  educational  level. 

Validity  and  Reliability.  To  satisfy  the  customary  psychometric  requirements,  the  questionnaire  was 
validated  by  a demonstration  of  content  and  construct  validity.  The  extent  to  which  the  questionnaire 
items  addressed  a series  of  dimensions  logically  related  to  facets  of  the  course  is  defined  as  content  validity. 
Construct  validity  can  be  established  by  citing  various  types  of  evidence  to  check  the  theory  underlying  the 
test.  In  this  instance,  the  evidence  was  examined  relating  to  whether  the  measuring  instrument  was  able  to 
detect  attitude  differences  when  they  were  expected  to  occur.  In  addition,  factor  analysis  was  used  to 
check  whether  the  intended  a priori  dimensions  were  actually  found  to  exist  when  the  questionnaire  was 
administered  to  a representative  sample  from  the  student  population.  As  a necessary  pre-condition  for 
validity,  reliability  of  the  questionnaire  also  had  to  be  established  empirically.  In  this  case,  reliability 
referred  to  the  internal  consistency  of  the  questionnaire  scales. 

These  analysis  requirements  prompted  the  design  and  conduct  of  a validation  study.  Moreover,  such  a 
study  permitted  identification  of  poor  items  for  subsequent  revision  or  elimination.  The  pilot  study  also 
provided  a method  for  testing  the  mechanics  of  administration,  particularly  the  unit  sampling  scheme, 
which  was  somewhat  complex,  and  for  detecting  problems  students  might  have  in  comprehending  either  the 
critique  items  or  the  instructions. 

Sampling  considerations.  Since  two  major  subpopulations  were  required  to  take  the  AFTSC  (officer 
trainees  and  enlisted  first-term  airmen),  it  was  decided  to  obtain  representation  front  these  two  groups.  For 
the  sake  of  convenience  and  because  there  was  no  reason  to  believe  that  Lowry  airmen  were  atypical,  the 
entire  sample  consisted  of  first-term  airmen  at  Lowry  AFB.  Officer  trainees  at  Lackland  AFB  who  took  the 
AFTSC  as  a regular  part  of  their  Officer  Training  School  (OTS)  curriculum  were  also  given  the  experimental 
version  of  the  critique  and  were  considered  to  be  representative  of  the  officer  subpopulation.  Although 
USAF  Academy  graduates  constituted  another  subpopulation  of  officer  respondents,  they  were  not 
sampled,  since  the  primary  intent  of  this  study  was  not  to  measure  the  attitudes  of  any  specific  subgroup, 
but  rather  to  determine  whether  the  measuring  device  was  appropriate  for  groups  with  higher  levels  of 
education. 

Administration.  A short  pretest  was  designed  and  administered  for  the  purpose  of  detecting  changes 
in  attitude  toward  the  course  over  time.  While  this  procedure  would  not  be  recommended  for  operational 
use  of  the  questionnaire,  it  was  felt  that  evidence  of  attitude  change  would  be  useful  in  establishing  validity 
in  the  present  study.  The  six  item  pretest  was  designed  to  measure  a single  dimension -overall  course 
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effectiveness.  those  items  were  irlenlieal  to  tlrose  on  the  Course  Critique  except  that,  tor  the  ptclcst.they 
wore  changed  troin  the  past  to  the  future  tense  where  appropriate.  Appendix  ('  eontains  tiro  pretest  m its 
entirety . 

1 or  the  enlisted  sample,  .ill  students  who  took  the  \1  ISC  dunit  a l-monilt  period  at  l own  \|  |t 
were  given  the  various  experimental  i|uestionnaires  (i.e..  I’retesi.  I nit  Critique.  and  Couise  CmiqucV  \i 
lowix.  the  liaffie  safety  course  was  usualh  completed  in  7 days.  Student  flow  through  the  couise  was 
hijth.  and  MH)  tesponses  were  ohtained  to  one  or  .mother  hunt  of  the  survey 

SiimlatU  . all  otticei  trainees  completing  OI'S  duting  the  d month  data  collection  period  participated 
the  study  Mowevei.  the  Traffic  Safely  Course  at  l ackland  was  less  concentrated,  with  units  hem,;  go  on 
piecemeal  over  a 7-  to  .!-week  period  Student  flow  was  much  lowei.  w ith  onlv  75  responses  collected 

llte  instructional  unit  item-sampling  procedure  was  based  on  a 10  percent  per  unit  concept  The 
instructor  was  required  to  count  the  nunihei  of  students  in  the  class,  divide  by  It),  pass  out  l rut  Critiques 
randomly  to  one  tenth  of  the  class  after  each  unit,  and  collect  each  unit’s  questionnaiies  attei  the  students 
weie  I unshed.  In  this  manner,  after  a substantial  number  of  students  had  taken  the  course,  enough  l ’nit 
l ritiques  would  be  available  to  pci  mil  valid  judgments  about  the  effectiveness  of  the  entire  unit.  Also, 
students  would  not  be  burdened  with  the  task  of  completing  10  l mt  Critiques. 


III.  Kt  SI  I IS 

/Vv,  ripth <n  ,> I sample,  tables  1 and  7 describe  in  detail  the  I own  and  lackland  gioups  with  icspect 
to  those  background  characteiistics  on  which  siibslanti.il  vanation  was  found  sex.  ace . and  educational 
level.  Nearly  all  the  1 own  group  held  the  lank  ol  I I (S>  >•  ».  the  l ackland  group  ty  pually  gave  "Office, 
liamee  as  a tesponse  to  the  rank  question.  Comparing  pretest  respondents  w ith  those  who  completed  the 
entile  l oiirse  Unique  showed  that  the  samples  were  veiy  much  alike  within  a single  base  that  is. 
percentages  within  the  various  categories  ol  sex.  age.  and  educational  level  weie  quite  simil.u  Acioss  bases, 
comparing  the  Cowry  and  lackland  gioups  showed  that,  as  expected,  the  lackland  gioup  was  oldei 
(lackland  mean  age  7.U.  1 owry  mean  age  l»  .?)  and  had  mote  formal  education.  In  addition,  females 
formed  a greater  proportion  ol  the  lackland  sample  C<\.5‘ , at  I ackland  vs.  »>  S at  1 ou  i\ ) 

Mechanics  ,\l  aihiunistrmion.  I lie  unit  sampling  procedure  was  found  to  be  mote  difficult  lot 
instructors  to  carry  out  than  had  been  anticipated  l iequentlv.  questionnaiies  weie  not  distributed  oi 
collected  according  to  the  plan  lire  number  of  unit  questionnaires  actuallx  collected  was  consideiablv 
smaller  than  was  expected. 

One  category  ol  educational  level  was  misunderstood  by  quite  a few  ol  the  enlisted  lespondents  I he 
c.itcgoiy  labeled  "some  graduate  school"  was  checked  In  main  lespondents  who  also  gave  then  age  as  less 
than  - 1 It  appeared  that  possibly  they  li.nl  misconstiued  the  required  response,  assuming  that  this  c ale-  oi\ 
meant  "graduated  from  school" (i.e  . high  school). 

Rank  was  another  area  somewhat  misunderstood  Although  they  death  held  some  official  tank  in 
addition  to  being  Ol  S students,  tank  was  not  given  by  a huge  mimhei  of  the  offieets  1 he  fact  that  no  tank 
categories  were  supplied  lor  this  item  may  have  contributed  to  this  confusion. 

I act, ’rial  valiJin  I actor  analvsis.  which  is  a technique  for  reducing  a huge  ttumbei  of  variables  to 
lewei  underlying  dimensions,  pennitted  a judgement  as  to  whether  the  intended  dimensions  of  attitude 
wete  actually  ictlected  in  (lie  i espouses.  Consequent  lx . a series  of  factor  analvses  was  peifoimed  on  the  fust 
40  ,u'ms  V"mpnsing  the  i onise  Critique  CO  items  pertained  to  the  insmieiot.  and  70  lelened  to  featmes 
Ot  the  couise)  Diese  analyses  weie  done  separately  on  the  l owry  and  lackland  data  in  oidct  to  diseovet 
wlictliei  simtl.it  conclusions  would  he  found  in  these  two  dispaiate  gioups  (Appendix  Ot  I'lic  general 
procedure  was  to  perform  fust  an  unconstrained  factor  analvsis  wlicic  tire  mimhei  of  faciots  to  emerge  was 
not  s, veil  red  in  advance  Next,  the  analvsis  was  constrained  to  a smaller  number  ol  faciots.  depending  on 
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was  lolatcil  to  congruence  with  the  l ackland  solution1 
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I I ) loi  Mityi'Mii^  this  mcthoil  ot  an.i’\Ms 


I’liui  tv*  factoring  the  K‘s|*v*nsi‘s.  negatively  wouled  items  were  teveise  scored  to  nuke  .til  items 
eonststent  ssith  tespeet  to  lavoiahility  I he  initial  solutions  produced  nine  factors  toi  each  student  pump 
\Uule  tlteie  wete  some  ditteiences  between  these  solutions,  they  were  indued  to  be  ininoi  \t  this  point,  it 
was  appaient  that  tliiee  majoi  t.icl**is  wete  present  (a)  an  instructor  general  factor.  (b)  a course 
etlectiveness  lactor.  and  (cl  a media  effectiveness  factor  (see  Tables  1)1  and  1)7  ot  Appendix  l>)  These 
thiee  lactors  accounted  toi  SO  ot  the  response  variance  in  the  lackland  data  hi  the  lowiy  data,  the 
environmental  factor  tailed  to  emerge  as  a single  entity , but  broke  out  as  tliiee  separate  tactois  ( 7,  S.  ')) 
with  high  loadings  on  single  items  Therefore,  it  wxs  decided  to  treat  the  euviiouniental  items  as  opinion 
items,  ratliei  than  as  contributois  I**  a scale,  and  to  drop  them  (torn  (inure  analvses  in  the  iniestigaln*n  ol 
vt  nest  ionium-  dimensionality  Also.  I actors  4.  5.  and  (*  m the  Lowiy  data  appealed  to  he  fragmented 
versions  t*l  1 actor  7 (lie  course  eltecliveness  tactor.  In  consideration  oT  these  results,  n was  decided  ti> 
constrain  the  solution  m the  next  step  h\  speeds  mg  that  only  three  lactors  he  extracted 


The  three  Tactor  solutions  are  presented  in  Tables  d and  4 Tor  lowry  and  lackland,  respectively  It 
can  be  seen  that  lactor  2 oveilaps  Tactor  d lo  some  extent,  hut  items  dO  to  dd  provided  the  clearest 
definition  ol  Factoi  d.  namely  . attitude  toward  media  etTcclivcncss.  Differences  still  remained  between  the 
l ow is  and  lackland  solutions.  Tor  example,  in  the  l oxxix  data. Factor  7 (course  eltecliveness  1 ssas  stiong 
and  cleatcut.  while  in  the  1 acklatul  data,  this  dimension  appeared  mote  weakly  as  Factor  d. 

As  an  ohicctivi  cheek  on  the  severily" or  these  ditTerenees,  the  pnncip.il -component  l acklatul  solution 
was  rotated  to  congruence  with  the  lowry  solution.  Coefficients  of  congruence  svere  .‘>7.  .NO.  and  .74  Tor 
Factors  1.  7.  and  d respectively.  These  can  be  interpreted  as  excellent,  setx  good,  and  moderate 
congruence. 


AJditk'nal  factor  analrr  s.  To  test  the  hypothesis  that  only  one  Tactor  (perceived  course 
etlectiveness)  was  present  in  the  pretest,  the  six  pretest  items  wete  analyzed  Tor  the  lowiy  sample.  The 
results  tended  to  confirm  the  hy  pothesis.  While  txxo  factors  emerged  m an  unconstrained  solution,  the  liist 
lactor  was  predominant  and  loaded  significantly  on  five  of  the  six  items,  accounting  Tot  NS  ol  the 
response  variance.  Table  Dd  (Appendix  D)  presents  the  obtained  loadings  on  the  two  Tactois.  F'ot  tuuhei 
analyses,  it  was  decided  to  eliminate  the  non-contributing  item  (item  7N)  from  the  perceived  course 
etlectiveness  scale.  The  results  ot  a similar  analysis  with  the  lackland  sample  ate  not  presented.  In  this 
analysis,  the  six-item  pretest  produced  three  Tactois  rather  than  one.  and  loadings  did  not  agree  with  the 
l.owry  imduigs  It  is  felt  that  this  discrepancy  occurred  because  the  number  ot  students  who  took  the 
pretest  in  the  l acklatul  sample  was  unite  small  (N- 75),  and  the  observed  result  w as  probably  unstable. 

I he  unit  xptestionnaircs  were  also  lactor  analy  zed.  Since  so  tew  unit  q uost unman es  were  completed 
by  the  l acklatul  group,  l acklatul  cases  were  added  to  the  I owtx  group,  and  the  analysis  was  completed  on 
a total  ot  4l>4  cases.  With  It)  different  units  represented  in  the  data,  it  was  decided  to  teniove  unit 
ditteiences  before  factoring;  otherwise,  the  lactoi  solution  could  be  influenced  to  an  unknown  degree  by 
variation  within  units.  The  alternative  approach  to  perform  10  separate  analyses  and  compare  them  was 
rejected  as  impractical,  and  also  because  it  was  desired  that  a more  geuei.il,  <>irrall  assessment  he  made  of 
the  tactor  structure  underlying  the  unit  quest ionnaiic.  Therefore.  lire  data  were  converted  to  standatd 
scores  h\  a I ranstonuat ion  involving  the  mean  and  standard  deviation  of  each  unit.  The  icsults  of  this 
analysis  tailed  to  confirm  unulimensionality  of  the  unit  v|uestioimaue.  Factor  loadings  are  presented  in 
laNe  l>4.  Naming  these  factors  presented  some  difficulty . however,  they  appealed  to  represent  (a)  attitude 
tow ,ud  unit  objectives,  (b)  altitude  toward  unit  questionnaires,  and(c)  attitude  towaid  level  of  detail. 

In  summary , three  major  lactors  were  (omul  in  the  Course  Critique;  fa)  an  mstructot  factor,  (b)  a 
course  etlectiveness  lactor.  and  (c)  a media  effectiveness  factoi.  Tables  .*  and  4 contain  the  factor  loadings 
lor  the  Course  Critique.  These  may  he  interpreted  as  correlations  of  the  individual  items  with  the  factors. 
Some  minor  ditteiences  between  the  lowry  and  lackland  solutions  wore  found  to  exist  in  the  Course 
( otiqno  Die  pretest  was  also  analy/ed.  and  one  genet al  factoi  perceived  course  effectiveness  was  found. 
Winn  factoring  the  l nit  Critique,  some  unexpected  factors  emerged,  however,  the  most  imjx'it.mt 

overall  lesson  effectiveness  w as  present  as  expecteil. 
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Table  Rotated  Factor  Loadings 
(Lowry  Students,  N-.UXM 


Table  4.  Rotated  Factor  Loadings 
(Lackland  Students  N=50) 


1 1#  m 

Factor  1 

Factor  2 

Factor  3 

i 

.72 

* 

* 

“> 

.78 

3 

.70 

4 

.57 

5 

.81 

6 

.85 

7 

.84 

8 

.81 

9 

.90 

10 

.80 

11 

.65 

12 

.62 

13 

.77 

14 

.80 

15 

.85 

16 

.92 

17 

.78 

18 

.84 

19 

.72 

20 

.92 

21 

.65 

22 

.49 

23 

.47 

24 

.48 

25 

.65 

26 

.81 

27 

.68 

28 

29 

30 

.62 

31 

.74 

32 

.87 

33 

.80 

34 

.71 

35 

.74 

36 

.61 

Discriminant  validity.  As  noted  by  Federico  (1971),  if  certain  items  are  able  to  discriminate  between 
groups  with  known  attitude  differences,  these  would  be  more  useful  items  for  inclusion  in  a final  version  of 
the  questionnaire.  To  examine  this  possibility,  a discriminant  analysis  was  run  on  40  items  from  the  Course 
Critique.  The  discriminant  function  was  able  to  differentiate  the  officer  and  enlisted  groups  quite  well, 
centroids  being  2.63  and  .64,  respectively.  In  addition,  94%  of  the  cases  were  correctly  predicted  as  to 
group  membership  by  the  discriminant  function.  Thirty-seven  of  the  40  items  had  significant  discriminating 
power.  These  are  listed  in  Table  5 along  with  their  standardized  coefficients  on  the  discriminant  function. 
These  coefficients  represent  the  relative  contribution  of  each  item  to  the  discriminant  function.  Using  an 
absolute  value  of  .15  as  an  arbitrary  cutoff,  18  of  the  37  items  made  relatively  strong  contributions. 
Clearly,  these  would  be  candidates  for  retention  if  a shorter  form  of  the  questionnaire  were  desired. 

Other  evidence  of  validity,  [f  the  questionnaire  was  sensitive  to  differences  in  attitude  which  are 
known  to  exist,  then  one  could  argue  that  the  questionnaire  was  validly  measuring  what  it  was  designed  to 
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lublf  ' Standardized 
Discriminant  I unction 
Coefficients 


!!•»«  Coefficient 


1 

10 

•» 

14 

4 

1 d 

s 

2b 

0 

.17 

n 

.04 

i) 

,0‘) 

10 

20 

1 1 

1 4 

12 

.10 

Id 

44 

14 

>7 

15 

0b 

lb 

.04 

17 

s r 

IS 

Ob 

14 

S I 

20 

.OS 

21 

dl 

1 A 

.do 

V ' 

0d 

24 

,0S 

25 

.24 

2b 

.04 

27 

.42 

28 

,d4 

do 

.11 

dl 

.05 

.07 

.'4 

.IS 

.A  5 

.14 

30 

.40 

d7 

Id 

ds 

.07 

d‘> 

.17 

40 

,2b 

measure.  It  was  widely  felt  In  course  managers  and  instructors  that  the  officer  group  would  dislike  the 
repetitive  aspects  of  the  course  and,  in  fact,  would  perceive  the  entire  course  less  favorably  than  the  enlisted 
group.  In  addition,  it  the  nuestionnatte  was  sensitive  to  changes  in  attitude  over  time,  this  would  he  further 
evidence  ol  construct  validity . lo  check  these  hypotheses,  a scale  was  constructed  by  summing  the  five 
items  which  had  been  identified  as  the  primary  factor  in  the  pretest.  This  scale  (items  21 , '2.  2d.  25,  and 
2<>  Irom  the  Couise  Critique)  can  be  thought  of  as  measuring  perceived  course  effectiveness.  Using 
perceived  course  effectiveness  as  the  criterion  measure,  a two-way  factorial  analysis  of  variance  was 
performed  with  test  time  as  one  factor  and  officer  or  enlisted  gtoup  as  the  other.  Twenty  -nine  subjects  were 
dropped  irom  the  analysis  because  scale  scores  could  not  be  calculated  due  to  one  or  more  missing 
responses.  Results  are  depicted  graphically  in  figure  I.  The  significant  interaction  showed  that  the  officer 
group  was  less  favorable  tow  aid  the  course  before  taking  it  and  became  even  more  unfavorable  aftei  having 
taken  rt.  Table  b contains  the  ANOVA  summary  table. 
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Figure  I.  Perceived  course  effectiveness:  Differences  between 
officers  and  enlisted  personnel. 


Tabic  ft.  Analysis  of  Variance  Summary 


Source  of  Variation 

ss 

df 

MS 

F 

P 

Time 

8.725 

1 

8.725 

.641 

.424 

Group 

3,405.580 

1 

3,405.580 

250.240 

.001 

Time  x Group 

70.975 

1 

70.97S 

5.215 

.023 

Residual 

8,737.149 

642 

13.609 

Total 

12.285.783 

645 

Reliability.  Although  factor  analytic  procedures  were  hclplul  in  identifying  items  tor  inclusion  on 
scales  and  in  naming  these  scales,  it  was  still  necessary  to  check  the  reliability  ol  the  questionnaire. 
Questionnaire  reliability  could  not  be  calculated  using  all  items  and  determining  internal  consistency . since 
the  instruments  were  not  intended  to  be,  nor  did  they  prove  to  be,  measuring  only  one  dimension.  A more 
appropriate  method  was  to  compute  the  reliability  of  each  scale  using  Cronbach's  Alpha  to  estimate 
internal  consistency  reliability.  Table  7 presents  these  results.  Low  reliabilities  were  observed  lor  scales 
within  the  Unit  Critique. 

Survey  results.  In  Table  8,  means,  standard  deviations,  and  values  are  given  for  items  of  the  Course 
Critique,  broken  down  by  officer  vs.  enlisted.  Those  items  which  did  not  fit  in  the  three  scales  are  presented 
in  Table  9,  with  percentages  of  respondents  in  the  various  response  categories.  In  these  instances,  chi-square 
tests  were  made  to  determine  whether  the  distribution  of  responses  differed  significantly  between  the  two 
groups.  Due  to  expected  cell  frequencies  less  than  5,  categories  in  items  41  to  43  had  to  be  collapsed  to 
meet  the  statistical  requirements  of  the  chi-square  test.  A number  of  differences  were  obseived.  Scale  scores 
are  reported  in  Table  10. 
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hihh  '.  Internal  Consistency  Rclialiilitv  Estimates 
for  Various  Derived  Seales 


Test 

Scale 

Number 
of  Items 

Alpha 

I’telest 

1.  Course  l lieeliveuess 

5 

.Sti 

l 'mt  Critique 

1.  Accomplishment  ol  Objectives 

4 

b8 

2.  Question  Suitability 

5 

.51 

5.  l evel  of  Icclmical  Detail 

•> 

.42 

Coutse  Critique 

l Instructor 

20 

.‘>5 

2.  Course  1- fleet  iveness 

14 

.‘<4 

5.  Media  I- flee  liveness 

4 

,80 

iiihlc  S.  Item  Differenees:  Course  Critique  (Items  I to  401 


item 

Lowry 

Lackland 

Difference 

Mean 

SD 

IN) 

Mean 

SD 

(N) 

t 

P 

i 

4.28 

0.05 

(204) 

1 .15 

(48) 

5.72 

<.001*** 

4.41 

0.75 

(205) 

4.17 

0.8b 

(48) 

1.05 

.055 

5 

5,55 

1.51 

(200) 
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1 .5  1 

(47) 

().b‘> 
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4 

4.5b 

0.7‘) 

(201) 

4.15 

0.05 

(47) 

1.55 
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5 

4.42 

0.81 
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4.21 

0.82 
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1 .(ib 

.000 

6 

4.41 
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4.21 
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1 .bO 
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1 .22 
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0 
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0 »0 

( 204 1 

4.17 
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0.82 

(205) 
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1.55 
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1 1 
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15 

4.47 
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14 
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0.8b 
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4.1  5 
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1 »4 
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lb 

4.45 

0.84 
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4.1  7 
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4.45 

0.7b 

(4‘>) 

1.74 

.084 

IS 

4.45 
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4.25 

0.00 
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1.60 

.0*12 
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5 .*>*) 

1.10 
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5.88 
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0b7 
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20 

4.4b 
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21 
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2.47 
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5.5b 
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2.1b 
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(40) 
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27 
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0.0.1 
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28 
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.‘•47 
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58 
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1.04 

(2‘>4) 
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0.28 
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5<> 
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1.21 
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5.40 

.001** 

40 

4.05 

0.8b 

(2‘»4) 
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0.75 
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0.85 
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Table  It1.  Seale  l'ifli-ri-mvs  Course  Critique 
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table  12.  Content  Analysis  of  Recommendations 


Respondent 


Comment 


Frequency 


Officers  (N- 50)  Very  limited  intellectual 

appeal:  dry;  boring 

Should  be  eliminated  because 
it  takes  up  valuable  lime 

Too  long 
No  comment 

Unlisted  (N=T00)  Acquired  useful  information 

or  enjoyed  class 

Boring 
Too  long 
Repetitious 

riimiuale  01  shorten  course 
because  most  people  have 
taken  driver's  education 

Pace  too  fast  to  answer 
questions 

Problems  with  media  equipment 
slides  out  of  order . sound 
inadequate 

Instructor  should  have  greater 
role  in  course 

Too  many  hours  per  day 
Update  films 

More  shocking  and  dramatic 
visual  presentations  ot 
accidents 

No  comment 


t.t 

TO 
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IV.  DISCUSSION 

Although  the  empirically  derived  factors  did  not  exactly  match  the  a prioii  intended  lactois.  a usable 
set  of  dimensions  was  found  to  be  present  in  both  the  Course  and  Unit  Critiques.  While  previous  leseaich 
(Kantor,  Vitola,  A (luiiin.  I‘>77)  with  the  tw  separate  Instructor  scales  fmstructoi  technical  competence 
and  instructor  peisonal  relations)  i.  d indi.  .ed  that  measures  could  be  obtained  on  both  these  dimensions, 
in  retrospect,  the  fact  that  only  one  factor  emerged  from  the  analysis  was  understandable.  This  lesult  can 
probably  be  explained  by  circumstances  peculiar  to  the  Al'TSC.  The  relative  brevity  of  the  course,  coupled 
with  the  fact  that  instructors  were  not  the  principal  medium  for  transmitting  information,  piobahly 
hampered  the  respondents'  ability  to  distinguish  two  separate  facets  of  the  instructor  lole.  C.iven  the 
relatively  minor  role  of  the  instructor  in  providing  instructional  content  in  the  multimedia  Al'TSC,  little 
has  been  lost  by  restricting  measurement  to  one  general  instructor  factor. 

With  regard  to  the  course  effectiveness  factor,  most  of  the  items  which  had  been  written  to  measnie 
this  dimension  were  successful.  Items  S and  *)  were  notable  exceptions  and  could  probably  be  dropped  with 
little  loss  in  information. 
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I >AN  suoiosslul  won-  itons  designed  Ik  moasiiie  (l\r  media  cftoetivonoss  dimension  Onls  tout  higlilv 
stable  .uni  inioiielalod  lions  eontiihntod  Ik  moasmmg  (Ins  dimension  SiioIi  a small  mimho  kI  items 
approached  the  lossoi  limit  Iki  inusiiiulmg  a soalo 

In  the  l ’mi  Cutupies.  .m»I\  .'in-  l.n  Iki  li.nl  boon  anticipated  mill  (ki  lesson)  iivciall  effectiveness  Iml 
I In  oo  won’  iKtnnl  upon  examinin'’  ilio  data.  Hkwovoi,  ilio  miomloil  taolKi  was  I lie  si  longest  ami  (ho  ulliois 
mas  lihv’ls  In-  ilmppovl  smiIikiiI  dctcalmg  Ilio  pm  pose  of  Ilio  l 'nil  (iilnpio 

lhssinul.il iln-s  IkiiiuI  hi  Ilio  Inssav  ami  lackland  facloi  skIiiIikiis.  wliilo  latgc  enough  Ik  oause  skiiio 
oKiiooin.  woio  iikI  viows'vl  as  soiikiis  enough  Ik  wan  ant  sepaialo  soalo  okiisIiiioIikii  ki  levisiKii  to  (ho 
vlimonsiKiis  as  piosonlls  ov'nooivoil  Sampling  oiiki  ami  Ilio  lac  I llial  Ilio  laoklainl  samplo  ssas  iclalivcls 
small  mas  have  aoonimiovl  Iki  ilio  Khlamovl  vhlloionoos.  Mntonvci.  al  least  nnnloiato  okii|Iuioiioo  kI  the 
facloi  skIiiIikiis  ssas  aohiovoil  in  Ilio  piosonl  samples. 

I ikiii  a pssoliKmoliiv  pi'inl  kI  vioss.  it  is  iisks.  if  iii'l  impiKpoi.  Ik  iiso  a single  item  Iki  assigning  a 
iuiuioiio.il  some  sshioli  is  mlorpiotoil  as  an  al  I it  nils'  measmomeiit  Ilio  lohahilits  kI  a mie-item  moasuio  is 
unloioiminato  using  mtoinal  okiisisIohos  oslmialniii  procedures  and  sskiiUI  ho  Ihooiotioalls  Ikss  hi  .ms  ease 
finis,  it  is  looKiimioinloil  that  allilmlos  toss  aid  inslmotKi,  okiiiso.  ami  movlia  ofloodvonoss  ho  moasmoil  hs 
moans  kI  mnlliplo  item  soalos  IIikso  developed  in  llus  slmls  ssoio  shown  Ik  have  ailoi|iialo  lohahihls  ami 
I’.kkvI  oKiistiuot  s.ilnliis  I nil  olloolivonoss  alsn  appoaioil  Ik  ho  a u'liahlo  ami  valiil  soalo.  I'lioio  is.  howevei . a 
vlolonsihlo  ssas  kI  mtoipioling  single  item  responses.  One  oan  obtain  a gioal  sloal  nl  inlKimaliKti  hs  vioss  mg 
single  items  as  opinion  slatomoiils  ami  oompaiing  froqnonos  vlisliihnliKiis  Ik  nlonlits  gionp  ililtoionoos  in 
lospnnso  patterns.  II  an  mi  favorable  losponso  oalogois  is  piokovl  iiikio  lioipionlls  Ilian  okiiM  I'o  aooountovl 
Iki  hs  rhaneo  among  a siillioionlls  laigo  mnnhoi  ol  people,  this  oan  ho  taken  as  evidence  that  an 
nnlasKiahlo  sitiiatiKii  o\isls  t in  square  tests  oan  ho  tisovl  Ik  determine  Ilio  siaiisiio.il  sigmfioanoo  ol  ilovianl 
losponso  pallonis 


\ . CONtl  I SIONS  ANI1  KHDMMI  NIVAIION 


Conclusions 

I Ilio  ovpoiimonial  soisikiis  ol  the  ('onrso  ami  him  Cutupies  ilemonsliatevl  ailoipiaio  oonlotil  ami 
okhsi i iii’l  valnhls 

' Kohahihls  w as  louml  Ik  ho  oviollonl  Iki  all  ilonvoil  soalos  ol  ilio  I onise  Ciitn{UC  ami  satisfactnrs 
Iki  Ilio  most  iin|n'ilanl  soalo  ol  ills'  I nil  ('nlupio 

a Soalos  ssoio  nidged  Ik  ho  appiopnalo  Iki  moasiittng  allilmlos  ol  isso  inaioi  siihgioups  sslio  look 
Ilio  Al  ISC. 

I I nsiiKmnonl.il  piohloms  oan  ho  identified  hs  spooilio  KpmiKii  items 

> Adimmstiativc  piKooilnios  Iki  oKlIoolmg  l 'nil  Cntnpio  nilKimatiKH  ssoio  matginalls  snooossliil 

(i  No  differences  holssoon  mills  with  loganl  to  olloolivonoss  ssoio  ohseivoil  in  Ilio  piosonl  sample 
I hat  is.  in  gonotal.  poisonnol  paitioipaling  in  Ilio  smses  loll  llial  all  the  units  ssoio  hurls  olloolivo 

7.  As  a ssIikIo.  Ilio  Al  l'SC  ssas  peiccivcd  lavKiahls  hs  Ilio  anman  giKiip  ami  i.ilhoi  untavKiahls  hs 
ilio  oflicoi  group  ssiih  allilmlos  in  I ho  lattei  group  gelling  iiikio  nnlavotable  all  oi  cxposiiie  Ik  the  okiiiso 

S While  those  limlings.  slnolls  speaking.  iIk  iikI  gonoiali/o  outside  kI  the  okiiIoiiI  aioa  nl  \ii  I moo 
liallio  Safety,  mans  nl  Ilio  i|nestions  ap|V.n  Ik  ho  apptnpnato  Iki  kIIioi  suhiool  mallei  ssiih  siulahlo 
niKihlio.il ikiis  When  suoli  apphoatinns  are  okiishIoioiI.  oliooks  kii  Ilio  lohahihtv  ami  valnhls  ol  the 
i|uostiKiinano  mas  ho  ailvisahlo 

Reoommondatimis 

I . Ilio  hint  Ciithpio  form  sIikiiM  ho  adopted  as  piosonlls  oKiislmotoil 
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The  Course  C ritique  torm  should  be  adopted  alter  modifications  to  sliorten  the  instructor  scale. 
The  revised  instructor  scale  strould  contain  the  following  ten  items:  2,4,5,10, 11,13,14,15,16,17. 

3.  In  future  versions,  consideration  should  be  given  to  lengthening  the  media  effectiveness  scale  by 
adding  similar  items. 

4.  Written  instructions  for  administration  of  die  Unit  Critique  should  include  a comprehensive 
example  to  clarify  the  procedure. 

5.  A procedure  for  analyzing  data  should  be  developed.  Analysis  capabilities  should  include  as  a 
minimum:  (a)  calculation  of  descriptive  statistics  on  any  possible  breakdown  of  the  population,  (b)  the 
•ability  to  produce  frequency  distributions  for  the  various  item  response  categories,  (c)  the  ability  to 
aggregate  data  from  various  administrations  of  the  survey,  (d)  two-way  or  higher  analysis  of  variance,  (e) 
cross-tabulations  with  various  statistical  measures  of  association  produced  as  part  of  the  analysis. 

6.  Personnel  who  would  analyze  survey  results  should  be  identified  and  trained,  if  necessary,  to 
perform  desired  analyses. 

7.  In  operational  use,  norms  should  be  calculated  and  trends  monitored. 
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APPENDIX  A:  QUESTIONS  COMPRISING  THE  COURSE  CRITIQUE 

Please  use  the  scales  below  to  describe  your  primary  instructor.  Check  the  part  of  the  scale  which  best 
expresses  your  feelings. 


1.  Ineffective 

Effective 

2.  Knowledgeable 

Ignorant 

3.  Boring 

Interesting 

4.  Dependable 

Undependable 

S.  Disorganized 

Organized 

6.  Unsure 

Confident 

7.  Convincing 

Unconvincing 

8.  Unprepared 

Prepared 

9.  Intelligent 

Stupid 

10.  Inefficient 

Efficient 

1 1 . Encourages 

Discourages 

12.  Criticizes 

Praises 

13.  Fair 

Unfair 

14.  Impatient 

Patient 

15.  Considerate 

Inconsiderate 

16.  Hinders 

Helps 

17.  Friendly 

Unfriendly 

18.  Supportive 

Hostile 

19.  Ridicules 

Compliments 

20.  Cooperative 

Uncooperative 
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The  following  items  pertain  to  the  program  taken  as  a whole.  Circle  the  response  which  most  nearly 
fits  your  opinion. 

SD  = Strongly  Disagree 
D = Disagree 

N = Neutral,  or  No  Opinion 
A = Agree 
SA  = Strongly  Agree 


1. 


My  approach  to  driving  will  probably  be 
affected  by  having  taken  this  course. 

I enjoyed  the  course/program. 

Taking  this  course  was  a waste  of  time. 

The  course  objectives  were  appropriate. 

I learned  a number  of  things  1 did  not  know. 

I have  a better  understanding  of  traffic  safety 
(rules,  precautions,  hazards)  since  taking  this 
course. 

I think  others  of  my  general  background  would 
profit  from  taking  this  course. 

This  course  addresses  a real  Air  Force  problem. 
The  program  made  me  feel  more  confident  about 
my  driving  skills. 

1 liked  the  automated  type  of  presentation  used 
in  this  course. 

The  learning  strategy  used  in  this  course  (rule- 
example-practice)  is  a good  way  to  teach. 

The  slide  presentations  used  in  this  course  were 
effective  in  getting  across  the  material. 

The  films  used  in  this  course  were  effective  in 
getting  across  the  material. 

I found  the  films  entertaining  and  enjoyable. 

I found  the  slide  presentations  entertaining 
and  enjoyable. 

The  way  the  instructional  content  was  presented 
was  appropriate  for  this  kind  of  subject  matter. 
Classroom  ventilation  was  about  right. 

The  classroom  was  not  dark  enough  for  audio- 
visual presentation. 

Seating  arrangement  allowed  me  an  unobstructed 
view  of  the  screen. 

Noise  level  did  not  distract  me  from  the  program. 
Most  of  the  noise  came  from: 

a.  outside  the  classroom 

b.  inside  the  classroom 

c.  no  noise  problem 

Classroom  temperature  was: 

a.  hot 

b.  warm 

c.  just  right 

d.  cool 

e.  cold 
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SD  D N A SA 


12  3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 


1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 


j 

i 


i ' 


It 


1 


23.  This  course  was  given  at  a bail  time  of  the  day  (e.g.  just  after  lunch,  etc.). 

a.  strongly  agree 

b.  agree 

c.  no  opinion 

d.  disagree 

e.  strongly  disagree 

If  you  agree,  tell  why: 


SECTION  V Recommendations  for  Change 


1 
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Airrxnix  H QUESTIONS COMI’RISINi;  TMF  I'NM  CKITIOl'I- 


In  this  sc v non  please  answer  lire  questions  only  with  respect  to  one  of  the  units  within  the  course. 
Unit  you  were  assigned  to  rate  

SO  - Strongly  Disagree 
D = Disagree 

N = Neutral,  or  No  Opinion 
A = Agree 
SA  = Strongly  Agree 


D N A SA 

2 3 4 5 

2 3 4 5 

2 3 4 3 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

S.  Tire  amount  of  time  provided  for  responding  to  the  slides  w ;» 

a.  far  too  short 

b . too  short 

c.  just  about  right 

d.  too  long 

e.  far  too  long 

l|  The  amount  of  coverage  in  this  unit  w as 

a.  far  too  little 

b.  too  little 

c.  just  a Knit  right 

d.  too  much 

e.  far  too  much 

10.  The  number  of  concrete  examples  given  in  this  unit  was 

a.  far  too  few 

b.  tix>  few 

c.  lust  about  right 

d.  too  many 

e.  far  too  many 


SD 


1 . The  questions  were  so  simple  that  (lies  weie 

an  insult  to  my  intellcgencc  1 

2.  The  objectives  of  this  unit  were  clearly 

stated.  I 

3.  Most  of  the  lime  1 understood  wlut  was  being 

asked  by  the  question  slides  I 

4.  In  general,  the  information  presented  in  this 

unit  was  up-to-date.  I 

5.  I feel  that  this  unit  clearly  achieved  its 

objectives.  I 

b.  This  unit  was  full  of  needless  detail.  I 

7.  This  unit  contained  too  many  technical  terms.  1 


Am  xnix  C QUESTIONS  COMPRISING.  Till  PRTTI ST 


The  follow  me  items  pertain  to  the  Traffic  Safety  Course  you  ate  scheduled  to  attend.  Circle  the 
response  which  most  neatly  expresses  your  opinion 

SO  = Strongly  Ihsagtee 
O = Disagree 

N = Neutral,  or  No  Opinion 
A = Agree 
SA  = Strongly  Agree 


1.  Ms  approach  to  driving  will  probably  be  affected 

as  a result  of  this  course. 

2.  I am  looking  forward  to  taking  this  course. 

3.  I think  this  course  will  he  a waste  of  tune. 

4.  I will  learn  a number  of  things  from  this  course. 

5.  I will  have  a better  undeistanding  of  traffic 

safety  (rules,  precautions,  hazards)  upon  com- 
pletion of  the  course. 

h.  This  course  will  address  a real  Air  force  problem. 


SD  D N A SA 

I 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

12  3 4 5 

1 2 3 4 5 

1 2 3 4 5 
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Airrsnix  n additiokai  i actor  anaiysks 


I'jblc  tV.  Nino  I- actor  Solution  of  Course  Critique  (Lowr>  1 


Kami  Factor  1 

Factor  2 

Factor  3 

Factor  4 

Factor  5 

Factor  1 

Factor  7 

Factor  • 

Factor  9 

Instructor 

1 

.530 

155 

.022 

005 

.058 

.60 1 

.1  13 

.oo ; 

.1  10 

■s 

.688 

067 

.030 

.032 

1141 

.275 

.080 

.002 

AX>4 

3 

.481 

.315 

055 

336 

040 

.154 

.004 

.01 1 

.034 

4 

.676 

.203 

010 

.028 

.044 

.108 

.038 

Oil 

.064 

5 

.516 

.003 

.085 

.032 

.536 

.027 

.080 

.085 

.040 

6 

.556 

.036 

.013 

.216 

410 

.156 

.078 

.011 

.051 

7 

.602 

.255 

.047 

.284 

.1X17 

.062 

.061 

.168 

.132 

S 

.613 

015 

.053 

.168 

412 

.010 

.047 

.075 

.055 

4 

.745 

.160 

050 

.205 

001 

.030 

.250 

.007 

.101 

10 

.614 

.103 

.075 

.120 

.155 

.430 

.055 

.074 

.08 1 

II 

.805 

142 

.020 

.054 

.004 

.132 

.038 

.010 

.076 

12 

.512 

177 

.050 

187 

.002 

.010 

.080 

.143 

.083 

13 

.811 

.!  18 

.031 

.006 

.00  5 

.023 

111 

113 

.046 

14 

.781 

.024 

070 

.000 

.174 

.101 

.033 

.065 

.063 

15 

.860 

.100 

.050 

.086 

.000 

.080 

.032 

.056 

.074 

16 

.705 

160 

.007 

1143 

.082 

.074 

.064 

.038 

.01 3 

17 

.820 

.040 

.151 

031 

.043 

.007 

.015 

.010 

.021 

18 

.706 

.070 

.005 

.131 

.104 

.101 

.020 

.036 

.052 

10 

.446 

.161 

.008 

.201 

111 

.114 

.150 

.143 

.007 

20 

.745 

.001 

.214 

.026 

.080 

.016 

.030 

.036 

.014 

Course 

1 

i:*j 

.6  20 

.074 

.031 

.047 

.070 

.005 

.007 

AMO 

> 

.238 

644 

.160 

.122 

.108 

.043 

.076 

.108 

.058 

3 

Ml 

.680 

.060 

.005 

.024 

.065 

.024 

.172 

AMS 

4 

.053 

.513 

.1  18 

.113 

033 

.1 18 

,0°6 

.1 16 

.005 

5 

.000 

.754 

.010 

.050 

.021 

.083 

.084 

.064 

.025 

6 

.200 

.742 

.060 

.102 

.000 

.025 

.010 

.005 

.085 

7 

.057 

.650 

.213 

.050 

.107 

.040 

.013 

.086 

A»8 

8 

.013 

.265 

.181 

.048 

.027 

.005 

.005 

.080 

.165 

0 

.030 

.370 

.124 

.035 

.101 

.220 

.083 

.003 

10 

.160 

.321 

.683 

.007 

.030 

.027 

.002 

.101 

.004 

II 

.017 

.426 

614 

.052 

.078 

.072 

.1 18 

.054 

.073 

12 

.018 

.351 

.714 

.160 

.013 

.063 

.121 

.258 

.105 

13 

.051 

440 

.473 

.287 

.053 

.041 

.120 

.0*3 

.132 

14 

.158 

.604 

.280 

.285 

.018 

.030 

.022 

.200 

.372 

15 

.100 

.533 

.452 

.204 

.010 

.016 

.004 

.240 

.354 

16 

.041 

.475 

.224 

.025 

.060 

.035 

.033 

.153 

.057 

17 

.047 

.131 

.027 

.005 

.010 

.024 

.118 

.513 

.120 

18 

.044 

.080 

1105 

.030 

.006 

.018 

.026 

OOo 

.470 

10 

.031 

.065 

.051 

.040 

.000 

.036 

.614 

.000 

.002 

20 

.086 

.141 

2°o 

.167 

.082 

.086 

.323 

.003 

,|OS 

I'abl c />-.  Nine  Fad 
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Ittmt  Factor  ! 

Factor  2 

Factor  3 

Factor  4 

Instructor 

1 

.638 

. 1 30 

.025 

.070 

> 

.706 

.003 

.000 

.205 

024 

.053 

.057 

.017 

4 

.470 

.071 

.(xn 

.350 

> 

.786 

.072 

.01  1 

.158 

.S|0 

.002 

.030 

.040 

~y 

1 

soo 

.033 

1 30 

.05 1 

s 

.7S4 

.135 

100 

.080 

0 

.874 

.010 

.005 

.050 

10 

.743 

.153 

.044 

1 1 

.670 

.070 

.210 

.013 

i: 

.620 

121 

.05  7 

.266 

14 

.SI  2 

.1 10 

.021 

.100 

14 

.822 

.040 

.OSS 

.004 

15 

,S7S 

.014 

.071 

.050 

16 

.023 

.010 

.018 

.027 

17 

.SIS 

.172 

.015 

.050 

IS 

.887 

.048 

.088 

.086 

|0 

,761 

.008 

.081 

.010 

:o 

>)  1 i> 

.065 

.055 

.044 

Course 

1 

.170 

113 

.665 

.053 

.1 S4 

.M*> 

.312 

.057 

5 

.030 

1 IS 

.462 

.127 

4 

.050 

.460 

.260 

.054 

5 

.060 

,|OS 

.741 

.305 

.013 

126 

.825 

.150 

7 

.053 

.056 

.781 

.201 

s 

.300 

.072 

.065 

.028 

Q 

.01 1 

.017 

.100 

.101 

10 

.008 

.607 

.178 

.125 

n 

.181 

.781 

.105 

.123 

i: 

.023 

.857 

.1  IS 

.150 

13 

.062 

.007 

.044 

.1 16 

14 

.001 

.382 

.136 

.066 

15 

.022 

.363 

.105 

.000 

lb 

.064 

.457 

.286 

.385 

17 

.001 

.004 

.080 

.681 

IS 

.414 

.006 

.150 

.644 

l1! 

.1 10 

.327 

.205 

.455 

20 

.070 

.140 

.058 

.101 

Factor  b 


Factor  € 


Factor  7 


Factor  • 


Factor  f 


.57*) 

.018 

.023 

.038 

.200 

JS6 

.027 

.010 

.017 

.082 

.540 

.136 

.044 

.108 

.044 

.462 

.203 

.103 

.201 

.211 

.026 

.128 

.362 

.081 

.131 

125 

.036 

.100 

.126 

.013 

. 1 68 

.004 

.1  17 

.131 

.208 

.038 

.021 

.200 

.002 

.058 

.140 

.037 

.128 

.064 

.044 

300 

.155 

.358 

.132 

.065 

.026 

.035 

.165 

.083 

.328 

.036 

l 

.080 

.068 

.476 

.00.5 

.002 

.103 

.020 

.300 

.073 

.038 

.078 

.053 

.240 

.060 

.001 

.007 

.035 

.040 

.125 

.070 

.05 1 

on 

.057 

.035 

.080 

.126 

.131 

.145 

.068 

.142 

.165 

.016 

.067  i 

.053 

.046 

.203 

.270 

.304 

.115 

.072 

.046 

.022 

.010 

.1 13 

.151 

.215 

.100 

.156 

.267 

.127 

.063 

.540 

.160 

.262 

.038 

.044 

.168 

.182 

.043 

.134 

.001 

.150 

.301 

.150 

ISO 

.146 

.030 

.326 

.064 

.020 

.010 

103 

.135 

.042 

.181 

.035 

.055 

.118 

.012 

.123 

.637 

.027 

.044 

.230 

.037 

.177 

.184 

.071 

.031 

.348 

.175 

.221 

.042 

.113 

.108 

.135 

.183 

.042 

.067 

.024 

.080 

.241 

.086 

.141 

.064 

.208 

.121 

.004 

.163 

.086 

.001 

.825 

.048 

.035 

.024 

.013 

.007 

.044 

.010 

.054 

.220 

.302 

.137 

.024 

.168 

.102 

.003 

.010 

.068 

.021 

.274 

.005 

.00  7 

.140 

.500 

.035 

.025 

.110 

.100 

.826 

.123 

.040 

.1X13 

f 


Table  D3.  Factor  Analysis 
of  Pretest  (Lowry) 


ltam« 

Factor  1 

Factor  2 

1 

.611 

.207 

2 

.765 

.050 

3 

.681 

.066 

4 

.630 

.522 

5 

.560 

.642 

6 

-.003 

.291 

Table  D4.  Factor  Analysis  of  Unit 
Questionnaires  (Combined  Group) 


Items 

Factor  1 

Factor  2 

Factor  3 

i 

-.082 

.575 

.000 

2 

.574 

.044 

-.129 

3 

.471 

.411 

-.227 

4 

.618 

-.147 

-.085 

5 

.664 

-.233 

-.051 

6 

-.183 

.654 

.409 

7 

-.111 

.055 

.580 

. < 
» 

: ; 
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